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RANKIIIG  OF  COW.'.WU'Ti  ORGAI.’IZAIIONS 


1,  Introduction.  This  p=iper  treats  some  probleirs  which  carae  up  in  connec-j 

! 

I tion  with  the  task  of  ranking  social  ori^anlzations  on  the  basis  of  their  cor.iv.on 
menb'^rs.  If  eind  ^^sre  two  ortcanizations  and  if  the  leade;  s in  ran  of^ 

the  mill  membere  of  ^ and  if  no  high  rankinp  members  of  belong  to  % 
would  feel  intuitively  that  ^ la  "higher"  than  ^^in  the  social  hierarchy.  In 
addition  to  the  relative  height  of  two  organizations  wo  are  also  interested  in 
their  relative  "spread".  If  for  example,  ^ and  ^^ero  each  divided  into 
leadern,  middle  group,  and  bottom  group,  and  if  the  common  members  of  the  two 
organizations  oeuno  from  the  middle  group  of  ^ but  came  from  all  groups  of 
wo  would  say  tnat  ^ has  greater  spi*ead  than  * 

If  there  wore  some  indoponcent  measure  of  the  holpht  of  individuals  one 
could  define  height  and  spread  relatively  easily.  For  example,  if 
ha?  r members  and  h(a)  is  a real  number  representinr  the  height  of  a we 
could  take 


(1) 


h(«)  = J XI  h(a) 

f ^ 


as  a measure  of  the  height  of  ^ and  for  the  spread  of  ^we  could  take  the 


variance 


(2) 


or  the  nuocimum  difference 

(3)  8'(^)  = m^3^  h(a)  - h(a) 


However,  in  general,  th'.ere  no  acce  tabl  moa.’ure  of  th  height  of  an  in- 
dividual so  it  is  desirable  to  construct  measuvos  which  depend  only  on  the 
amounts  of  overlapping  between  subdivisions  of  the  v.rious  organizatiens.  Here 
the  measures  may  be  only  relative,  l,e,  will  merely  tell  which  of  two  organize- 


1 
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tione  1b  higher  wltnout  f^ivlng  a measure  of  the  absolute  height  nf  either  r.~  Thw 
organizations  being  compared, 

2,  Relative  helgnt  and  spread  of  pairs  of  organizations.  We  suppose  that 
each  organization  ^ is  subdivided  into  n strata  starting  with  o 

highest  group  and  going  dorm  to  a lo’vest  group  We  set 

(4)  Pi  = 0(^^)  / O(^)  (i  = l,...,n). 

[For  any  group  n v/e  denote  by  C (ft)  ihe  nur'bnr  of  members  of  /t  Let  I 

a flccond  ori-anisatlon  with  ctratn  ^ and  cot 

(5)  qj  = 0(‘7p  /O(^). 

Row,  if  not  empty  nc  sot 

(6)  a 0(Pj  /0(p/)9^  (i.J  a 

Wo  wish  tc  construct  some  function  of  the  4i,  j'ij  which  will  tell  which  of 

and  higher  and  to  construct  another  function  which  will  tell  which 

has  great  spread. 

A special  case  of  importance  is  that  of  equal  subdivisions,  i.e. 


p.  = q.  = 


(i  = l,...,n) 


’.There  0"  = - . In  tliis  case  the  functions  will  depend  only  on  the  n bv  n matrlc 
n 

R = (^ij). 

First  consider  the  problem  of  relative  height.  If  an  Individual  a belongs 
to  Pi  ^3  where  i>J,  i.e,,  if  he  occupies  a higher  position  in  ^ than  in 
then  so  far  as  this  individual  is  concerned  ^ is  higher  than  ^ , Tills  con- 
clusion, of  course,  deponds  on  thf-  assuny  tiens  that  the  indiviaual  trlea  to 
.achieve  as  high  a ooit.lon  as  possible  in  each  organization  to  v.-hlch  he  b.'longs, 
and  that  the  po.citlon  achieved  by  any  individual  depends  "'nly  on  Ms  "V.eig'-;"' 
(which  i7e  do  not  know).  In  practice  r.tith^r  of  tV-r-e  assuciptirnc  is  valid  for 
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each  Individual  although  they  might  tend  to  be  correct  in  the  average. 

One  would  say  tha.t  an  individual  in  Px  gives  more  evidence  of  dif- 
ference in  height  of  ^ pnd  ^th*an  one  in  This  suggests  the  fol- 


lowing function 


f(R)  = X (i-J)  r. 


and  the  definition  ^ is  higher  than  written  ^ ^ if  f(R)^0,  If 
f(R)  = 0 we  say  that  ^ and  ^have  the  same  height,  written 

r^j,  Vj  = ^ r^j  (i,j  = l,-..,n).  Then  we  have 

(9)  f(R)  = £“i(u^-v^). 


To  see  this  we  write 


f(R)  = 


' f f " hj  • f ^ = -f  ' “i  • f ^ ’'j 


1 (Uj-Vj). 


Next,  for  spread  we  first  consider  for  each  i the  average  position  in  /of 


the  members  of  This  is  given  by 


r =;  -= 

^i.  ui 


and  dually 


X J 

J 


(i  = l,...,n) 


r . = — 2L  - r.  , . 
'j  VJ 


We  then  introduce  the  function 


(12)  g(R)  = X |(r,  - if  - (r  , -if  Jff] 

and  say  that  jp  has  greater,  squul,  or  less  spread  than  according  as  g(R) 
is  positive,  zero,  or  negative. 

These  functions  f(R)  and  g(R)  arc  not  the  only  ones  that  could  be  used, 
and  are  introduced  primarily  so  as  to  provide  something  concrete  to  work  with 
in  building  a theory. 


I 
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We  observe  that  if  p/]yie  empty  (e.g,  p=  Rotary,  Lions  or  p = 
Methodists,  ^ s Catholics)  we  get  no  comparison.  One  might  say  if 
empty  but  m and  arc  not  empty  we  should  somehow  use  the  functions  f 

and  g computed  first  for  jP  and  and  then  for  ^ and  ^ and  then  make  some 
comparison  of  ^ and  Such  a comparison  would  be  justified  only  if  the 

order  given  f(  ) is  transitive,  i.e.  , ^and  ^implies  p , 

This  is  not  the  case  as  the  following  example  shows.  Take  n=2  and  let  the  only 
common  members  be  those  Indicated  in  the  table  below. 


®1 

‘Vi 

‘^l 

P2 

In  spite  of  their  limitati  ns  the  functions  f and  g may  be  useful  as 
building  blocks  in  a theory. 

3.  Unbalanced  stratification ..  We  turn  next  to  the  case  of  unequal  subdi- 
visions, and  consider  how  the  numbers  pj^,  qj  should  be  introduced  into  the  mea- 
sure, The  point  of  view  we  take  is  that,  theoretically,  one  should  always 
strive  for  equal  subdivisions  and  the  numbers  p,,  qj  should  be  used  in  correct- 
ing the  matrix  R f 03*  any  bias  introduced  by  unequal  subdivisions.  We  do  this 
by  constructing  a r.cv;  matrix  R*  = (r?,)  vihose  entries  are  estimates,  based  on 
the  observed  r^j,  p^^  q^,  of  what  the  matrix  R would  have  b'--cn  had  the  subdivi- 
sions  been  equal.  We  shall  describe  the  process  of  passing  from  R to  R as 
removing  the  bias  caused  by  use  of  unbalanced  ctratification. 

We  now  set  up  some  general  criteria  which  will  serve  as  tests  for  the 
adequacy  of  various  bias  removing  constructions. 

First  we  have  some  requirements  for  whatever  functions  are  used  to  measure 
height  and  spread.  If  the  subdivisions  of  ^and  */^re  equal  and  the  matrix  R 
is  symmetric  (r.e,  we  require  that  P and  ^^shall  have  the  same 
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and  the  same  spread. 

Consider  the  case  of  a ain{;le  or'vjiization  p stra Lifted  by  two  different 
investigators  into  subsets  and  ^ with  corresponding 

proportions  and  q2****>*^n*  ®PP^y  ir.easures  of  height  and 

spread  treating  p as  though  it  wore  two  organizations.  He  assume  that  the  two 
stratifications  are  consistent  in  the  sense  that  there  exists  a simple  ordering 
of  the  individuals  which  is  a refinement  of  both  stratifications.  This  is 
equivalent  to  the  requirement  that  for  each  i and  j one  of  the  two  sets 

contains  the  other. 

This  assumption  makes  it  possible  to  compute  the  r as  functions  of  the 

i J 

Pj^  and  qj.  Clearly  r^^^  = min  (p^^q^)*  Proceeding  inductively  wo  get 

(13)  + ^i2  + •••  + ^ij  - max(o,qi  + •••  + qj“Pi-»..-Pi_l)) 

and  its  symmetric  counterpart 


'"ij  ^ij  “ max(o,p,  +...+  . ,-q,_i ) ) 


In  particular 


(15)  Uj^  — p^i  Vj  — qj  (i»J  = l|,,,in). 

Now  suppose  that  a function  R*  = b (RfP^i* • • »Pp»  ic  proposed 

as  a bias  removing  construction.  Complete  removal  of  bias  for  two  consistent 
stratifications  of  a single  organization  ^would  lead  to 


R =(T-In, 


since  this  is  what  would  be  obtained  from  consistent  equal  subdivisions.  How- 
ever, if  this  wore  not  achieved  one  might  ask  tht*t  R*  be  symmetric,  i,e. 


R*  = (p*)Tr  , 


here  Tr  indicates  transposed  matrix 
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If  R Is  symmetric  then  we  at  least  are  assured  that  we  will  not  be  claiming 
that  an  organization  is  hi.^her  than  (or  has  more  spread  than)  itself. 

Finally  with  reference  to  particular  measures  f(R)  and  g(R)  of  relative 
height  and  of  relative  spread  we  night  ask  thiat 
(18)  f(R*)  = 0 and  g(R*)  = 0. 

Note  that  (l6)  guarantees  (17)  and  (18),  and  (17)  guarantees  (18)  whereas 
knowing  that  (18)  is  true  for  one  pair  f(  ) and  g(  ) gives  no  guarantee  that  it 
will  hold  for  other  measures.  Thus  it  is  highly  desirable  to  achieve  (16) 


and  (17), 


4,  Bias  removal  by  matrix  multiplication.  If 


jp  and  ^ 


are  two  stratified 


organizations  the  bias  in  the  comparison  matrix  R can  be  regarded  as  comLng  fror 
unbalance  in  both  stratifications.  It  is  natural  to  ask  if  wo  can  remove  the 


bias  in  tv.o  stops,  one  to  care  for  tho  unbalance  in  the 


and  ono  for  tho  un- 


balance in  the  and  moreover,  so  that  the  first  step  is  independent  of  ^ 

and  the  second  step  is  indspendent  of  ^ , In  other  words  wo  ask  if  it  is  pos- 
sible to  associate  a correction  operation  with  each  stratification  of  each 
organization. 

Lot  ]Px»***»  ^xx  “ stratification  of  ^and  lot  ^1,...,  5^  be  a con- 
sistent equal  stratification,  juare  we  assume  either  that  0(jp)  is  divisible  by  n 
or  that  o(f;^  is  large  enough  in  comparison  with  n so  that  approximately  equal 
subdivisions  are  ..-oasiblo.  For  example,  the  case  0(^  = 10  and  n = 6 would  be 
ruled  out,  but  O(^)  = 50  and  n = 3 would  be  accepted.  Actually  tho  corrections 
obtained  can  bo  applied  in  every  case  but  the  Justification  depends  on  the  exis- 
tence of  the 

Now  suppose  that  pj^j  is  tho  proportion  of  which  lies  in  ^1,  i.e, 

Pij  - 0(  ^ /^£.)  / 0(  jPj).  Clearly  = (J  ( Pj  , hence 

^ PiJ  = 


(19) 
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SLnce  Pj  = '^(  Pj)  / &nd|T‘=  0(^i)  / 0(^  we  heve  frcm^i  = 

J 

t 

' r _ T , o(fj) 


— = — y o(f  /)£i)  = X ---- 

0(f)  0(f)  T J j 0(fj 


P P 
Ij  j 


Because  of  our  assunpt.ion  of  consistency  ''et'/con  the  ^ and  1 stratifi- 


cations we  get 


0 if  p^+  ...  +Pj  ^ (i-1) 

p^+  ...  +p^-(i-l)«-if  p^+  ...  +Pj_^  ^ (i-l<r“<p^+  ...  +Pj  ^i£T" 

if  p + ...  +p.  ^ (i-l^and  ior.<p  + ...  +p 

Pi1  Pi"'  1 1 J-i  1 j ^ 

^ ^ Pj  if  (i-l)r-^  ...  +Pj  ^ and  p^+  ...  +p^  ^ ir~ 

1^-  (p^+  ...  +Pj_j^)  if  (i-l)tf~^  pj^+  ...  "Pj_2^  ^ i<r^p^+  ...  +pj 
, 0 if  p^+  ...  +Pj_^ 

iTc  define  the  hiae  correction  for  ^ to  be  the  replacement  of  the  matrix 
R by  the  matrix  R*  where 

This  has  the  effect  of  splitting  into  the  same  proportions  as  is 

split  by  the 

In  matrix  form  (22)  becomes 
(23)  R’  = P R 

whore  P = (p^j)* 

To  remove  the  bias  caused  by  inequalities  in  the  stratificaticn  of  ^^we 
form  the  matrix  Q = (^jj)  v/hero  = 0(  %nli)  / O(^)  and  then  replace  R' 
by  R*  where 


=f’'i 


U'  * 


I 

J 
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(25)  R*  ^ R'Q^  = PMj'^ 

Tne  associativity  of  matrix  multiplication,  l.e.  (PR)  = p (RQ^),  show^ 
that  the  final  result  Is  independent  of  the  order  of  the  corrections. 

The  following  example  Illustrates  the  procedure.  Let  ^ = ^^havt  two  con^ 
sistent  stratifications  in  which  = ^,  P2  = p^  = and  = i, 
q^  = ^ then  (see(13)  and(21)for  computations  of  R,  P,  and  Q) 


(26) 

5 5 ° 

1 0 0 

R = 

0 ^ ^ 

» p = 

i “ 0 

, Q = 

o 6 

3 2 

0 0 1 

0 J 1 

r 0 


and 

(27) 


R*  = P R QTr  = 


-5 

27 

lii 

i 


A 

27 

5? 

li 


12 

I 

4 


This  result  Is  no  accident.  For  let  jl^ ^ and  be  any  two  consistent 
stratification  of  an  organization  and  let  R*  = PRQ^,  Then  u*  - = ^whero 
u*  s etc,  Fe  have 

(28) 


u: 


New  by  U9),j^q^^=  1,  hence  uj 

By  (15)X^A~  benco  u*  = The  proof 

# ^ 

for  Vj  similar. 

It  now  follows  from  (9)  that  f(R*)  = 0,  l,e.  condition  (18)  holds  for  the 
f(  ) defined  In  (8),  However,  for  R*  given  by  (27)  wc  do  not  have  g(R*)  = 0 
hence  the  second  luilf  of  (18)  falls  for  the  g(  ) of  (12),  Of  course  (27)  shows 
that  neither  (17)  nor  (16)  hold  for  this  type  of  bias  correction. 


L 
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Bor*  g«n«rally  w*  ask  for  ways  in  which  a matrix  P can  be  assigned  to  each 
(Pj^,  ...  fP^)  80  that  wherever  'Pv  ^ are  two  consls- 

tent  stratifications  of  an  organization,  that  R = PRQ'^^  has  = Vj  = o-— 

(i,J  =1,  ...  ,n).  In  view  of  (28)  it  is  sufficient  to  have  equations  (19)  and 
(20)  for  each  P. 

We  naturally  require  that  P = if  p^=  ...  =p^j  =(y- since  then  there  is 
no  bias  to  be  corrected.  Now  if  ...  =q^  =q — , i.e.  Q = we  get 

“*  f-iy  = Pi- 

This  shows  that  condition  (20)  is  also  necessary.  We  have  not  been  able  to  de- 
teraine  if  condition  (19)  is  neoessazy. 

5.  Bias  removal  by  simultaneous  corrections.  Although  this  first  method 
is  not  entirely  satisf  .atory  it  points  the  way  to  a second  imporved  method. 

One  objection  to  this  first  method  is  illustrated  by  our  example  above.  Here 
^ was  too  large  and  we  corrected  each  r^j  to  take  account  of  this.  Now, 
sinoe  JTl  and  ^1  is  higher  than  ^2  perhaps  we  should  have  assumed 

that  all  members  of  belonged  to  ^ 1 and  have  made  any  necessary  cor- 

rections on  the  later  r^.  The  following  method  incorporates  thio  idea. 

Suppose  that  U...UR.I  c£i  a..UL^R  U-VpJ 

i.e.  Pj^+  ...  if"-^  Pj+  •••  +Ph*  seems  reasonable  to  require  that 

H # 

(29)  U;^+  ...  +Uj^  = u^+  ... 


where (i^^  (p^+  ...  +p^^  ^))  / Pj^.  This  is  equivalent  to  arr.uring  that 

for  each  organization  ^we  have 


(30) 


0((ri  U...U£i)nR  OH 2^  U...i/£i)nR) 


o(  f h n 7) 


c(f,) 


We  introduce  a more  detailed  note  tit. n to  cai  e for  all  i.  Let  h^be  defined 


by  the  equation 
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(31) 
and  let 

(32) 


( y • • • > n) 


o<i  - (1 


- 1,  ...  ,n). 


Similarly  suppose  that  k and  ^ are  defined  by 

w J 


(j=li  ...  »n) 


(35) 
and 

(36) 


^ j — (j^”“  •**  / *^k  ^ •••  >*i)» 

J J 

* 

Wo  now  define  u and  v inductively  by  the  equations 
^ J 

u^  = + ...  +Uhj^_i  + - uj-  ...  (i  = 1,  ...  ,n) 


(36)  yj  «:  v>  ...  + /^j  ^ •••  "^j-1  ••• 

Our  next  task  is  to  define  a matrix  R = I';.!  for  which  the  u*  and 

V.  are  respectively  the  row  and  column  sums.  Our  definitions  arc  ir.^luctive;  to 
J 

determine  r^^  we  assume  that  all  r^^j,  r^j^  with  h4i  or  k<J  are  already  known. 
First,  we  set 


(37) 

= “-i' 

■ ^hil-  ••• 

(ij 

= 1 

(38) 

^ij 

° ''■'J  ■ 

- ^lkj“  - 

(ij 

= 1 

(39) 

« 

°lj 

= Ui  • 

« •• 

■ **11  - ••• 

• 

-*‘ij-l 

(l»  J 

= 1 

(40) 

« 

'ij 

« 

= "j  • 

« 

■ ^ij  ” ’** 

n ^ 

» 

(1,J 

= 1 

(41) 

# 

’'ij 

= min 

^ij»  ^IJ* 

max  (c^j 

“'^l°ij » 

‘^Ij 

Note,  that  for  i = j = 1 (4I)  reduces  to 
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Thus  w*  8*6  that  tbl8  stcond  method  of  removltiR  bias  meets  our  strongest  test 
condition  (16),  whereas  the  first  method  gives  only  the  weaker  condition  (18) 
and  this  only  for  the  f(R)  given  by  (9). 

6«  Some  relations  between  the  unbiased  matrices  and  their  functions.  Let 
be  the  comparison  matrix  after  bias  is  removed  by  matrix  multiplication. 

Let  be  the  comparison  matrix  after  bias  is  removed  by  simultaneous  correc- 

e e tt 

tions.  Let  and  Vj  denote  the  row  and  column  sums  respectively  for  R^ 

(uj  and  Vj  will  refer  to  H^). 

First  we  will  show  that 


(48) 


«i- 


To  prove  this  it  is  convenient  to  have  (21)  written  in  a different  form.  After 
dividing  both  members  of  (21)  by  Pj  and  introducing  the  hj^  defined  in  (31) 

we  get 


■■ij 


0 

if 

^ ^ ^i-1 

if 

<:h^ 

if 

Vl  = -J 

1 

if 

hi^l  < J < b 

o<i 

if 

0 

if 

hi<J 

where  = 


i-r-  Pi-  •••  -Phi-i 


Vi 


and 

1 


Ol  el  ?1-  •••  ~Phl,l~l  ^ P^-t-  «««  ’*'Phl_l  ~ 

Phi_i  Phi_i 


Rememboring  that  = PRQ^»  and  using  (28)  and  (19) » we  write 
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ff«  have  from  (35) » using  tha  new  notation, 

# n # n 

(51)  = u^+  •••  “(C2+  •••  +®i_2 

and 

(52) 


2 


®1-1  ' V •••  "hj.i-l  + -<V  — +®j-2>- 


Henoa,  on  substituting  (52)  in  (51),  ««  write 


(53) 


^i  = 1-iKi.i  + %_i+i+  •••  +%-i  + •^i%i»  ^ Vi  <*^i 


if  h^_2^  = h^,  then 

(54)  = (*<i-  •‘1.1)  = C = Pihi«hji 


since 


®*r  *^i-l 


lff--(p^+  ...  +Phi_i 

Ph. 


(i-i)r^(Pi+  +Phi-i 


Ph. 


Ph, 


So  In  any  case,  we  see  by  (49)  that 
(55) 

J 


• 


for  if  J Pij  = '*i  “ '*i  * * similar  argument 

(56) 


« - 


Next  we  will  prove  ttat 


(57)  f(Rj)  = f(R^). 


By  (9),  (48)  and(56) 


= X ^^“i  ■ = X “ ^i^  = ^(rJ) 
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7.  Some  llluatrative  examples.  The  particular  cases  of  equal  consistent 
and  unbalanced  consistent  stratifications  have  been  covered  in  the  development 
of  the  theory.  V7e  will  now  illustrate  the  theory  for  unbalanced  stratif Icationj 
when  a comparison  matrix  R is  given. 

Example  1.  Let  ^ and  % two  organizations  with  two  stratifications 
each  where  ?2  = = ^»  q2  = ^ 


For  example,  ^ may  have  50  memi-.,rs  with  20  Y longing  to  and  30  tc 
and  contain  70  members  ?/ith  40  belonging  to  and  30  belonging  to^^. 

Of  the  10  members  ^and  ^^have  in  common  2 of  the  mem'-ers  in  are  also  in 
I 4 of  the  members  in  ^ are  in  3 members  in  ^ aro  in  and 

1 member  in  is  in 

irc»  uj  = is>  “2  = 10’  ’'1  ' io  ''2  • lo- 
f(H)  = Kjj  - ■ io*  ■ ■ io’ 

Thus  we  conclude  that  is  higher  than  ^ for  tbo  biased  matrix  R, 

Further,  *“1,  = |»  ^2.  ” 1 ” | **  2 “ ^ ^ 

g(R)  = (f-l)"|.(^-2;2^.(|-l)"|.(|-2)2l 

-(I  - 1)^  I - (I  - 2)^  ? - (I  - 1)^  I - (|  - 2)^  i = =?r  . 


5 720 


So  we  say  ¥ has  greater  jpread  than 


We  wish  also  to  find  the  unbiased  matrix  R^,  From  the  definitions  of  p^^ 

and  q , using  the  particular  illustration  with  50  and  70  members  respectively, 
^ J 

we  find  that 
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^ I 


and  Q = 


In  general,  P and  Q may  nlso  be  found  by 


(21)  J 


R*  = (PR)  qTr  = 5I 


Hence  by  (9)  and  (12), 


1?  25 

15  5 


2 1 

8 8 

0 1 


21  43 


21  11 


,034,  trhere  an  approximaticn  symbol. 

Finally,  R2  is  found  in  the  following  nray.  Since**'  = i 

1 _ g 

^ ^ 5 5 ” ~~ — I — ^ — ~ 6 * 

^ ^ 7 

Similarly  when  i = 2,  hp  = 2 and  = 1,  when  j = 1,  k.  =1  and  =.  5 and 

* * 118 

when  J = 2,  k2  = 2 and  ^ = 1,  Thus  by  (35)  and  (36),  u*  = +®<j^ 

= ^,  V*  = and  V2  = Further  using  (37)  and  {X),  = ^^2  “ ^21  “ 

°12  " °21  ""  lo’  °22  " ^11  " " ^12  ""  ^^21  ""  ‘^22* 

(41)  we  get  in  order 

* * -i 

°11  = “1  = y 

■•*1  = [§’  ih  [I  - 6 ■ iJ’  is|  ' (f’  m]  = IS* 

'12  = “J  - = il 

■,»  » 9 

d.„  = V.  = -rt 


{is-  w'  [8  - il]]  = fe’ 
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0 16 


Hence 


.016. 

In  this  example  the  tno  bias  corrections  lead  us  to  oppostie  conclusions 
for  relative  spread. 

Example  2,  Let  ^ and  ^^he  two  orranizationa  with  throe  stratifications 
each  where  p^  = i,  p^  = 1,  p^  = ±,  ^2  " 5’  ^3  ^ 5 


240 
0 10 
10  2 


By  the  methods  used  in  example  1 v/e  find  that 


» 1 

= ISO 


40 

32 

0 

23 

22 

0 

21 

6 

36 

# 1 ' 

24 

0 

0 I 

R = 

4 

11 

0 1 

2 60 

0 

9 

12  1 

We  thus  find  the  relative  height  nd  relative  swca>'  num’' .rs  as  .-iven  in  Tablel, 

Table! 

I g I f 

R .062  -.200 


U /^.217 
60 
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For  relative  spread  all  three  tests  eive  the  same  result,  i.e,  has 
preater  spread  than  As  for  relative  height,  the  unbiased  matrices  give  a 

result  which  differs  from  that  of  the  biared  notrlx. 

Example  3.  Let  ^ and  ^be  two  organizations  with  three  stratifications 

each  where  = J,  p2  = ^,  = |»  ^2  = h ~ 3* 

and 


17 


R = 


0 

0 

1 


We  find 


0 

0 

0 


1 

0 

0 


end 


0 2 
0 1 
0 0 


From  those  values  of  R we  get  Table  2, 

Table  2 


* 

a 

CJ 



R 

0 

0 

2 

" 9 

1 

4 

- Z 

9 

E 

Without  bias  removing  matrices  we  would  conclude  from  Table  2 that  the 
two  organizations  have  the  same  relative  height  and  tho  same  relative  spread. 
But  the  unbiased  matrices  show  that  jp  is  higher  than  ^^^v.hereas 
greater  spread  than  ^ , 
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Example  4.  Let  and  two  organizations  with  four  stratifications  I 


each  where 


V P?. 


3*  “^2 


? ”3 


l>  h - I' 

i O = i 
6’  \ 3* 


R - -i 
^ ■ 10 


0 1 
1 1 
0 0 
0 2 


= zfe 


27 

9 

9 

27 

9 

35 

43 

33 

0 

16 

20 

12 

108 

36 

24 

72 

R»  _ 1 

^ - r?a 


9 

9 

0 

0 

6 

8 

16 

0 

12 

0 

0 

0 

9 

7 

8 

36 

along  with  R give  the  numbers  found  in  Table  3, 


Table  3 


s 

R 

1.528 

« 

R, 

-.043 

4 

-.965 

From  Table  3 we  conclude  that  ^ is  higher  than  in  all  cases.  The  two 
bias  removing  tests  Indicate  that  y has  greater  spread  than , but  the 
given  matrix  Indicates  that  ^ h&s  greater  spread  than 
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Those  examples  indicate  the  importance  of  the  bias  romovLig  processes  and 
also  that  each  method  for  removii.g  bias  has  value.  In  example  1 we  see  that 
bias  removed  by  simultaneous  corrections  is  necessary  for  relative  spread.  In 
examples  2,  3,  and  4 wo  see  that  some  sort  of  bias  removing  method  is  needed. 
If  wo  wish  only  to  tost  relative  hoifht,  then  the  R*  matrix  is  unnecessary. 
Further  in  all  the  examples  g(R^)  ^ ffhethsr  this  is  Generally  true 

is  still  an  open  question. 


